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ABSTRACT 

A  number  of  multivariate  exponential  distributions  are  known, 
but  they  have  not  been  obtained  by  methods  that  shed  light  on  their 
applicability.  This  paper  presents  some  meaningful  derivations  of  a 
multivariate  exponential  distribution  that  serve  to  indicate  conditions 
under  which  the  distribution  is  appropriate.  Two  of  these  derivations 
are  based  on  "shock  models",  and  one  is  based  on  the  requirement  that 
residual  life  is  independent  of  age.  It  is  significant  that  the 
derivations  all  lead  to  the  same  distribution. 

For  this  distribution,  the  moment  generating  function  is  obtained, 
comparison  is  made  with  the  case  of  independence,  the  distribution  of 
the  minimum  is  discussed,  and  various  other  properties  are  investigated. 
A  multivariate  gamma  distribution  is  obtained  by  convolution,  and  a 
multivariate  Weibull  distribution  is  obtained  through  a  change  of 


variables . 
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Introduction. 


Exponential  distributions  play  a  central  role  in  life  testing, 
reliability  and  other  fields  of  application.  Though  the  assumption  of 
independence  can  often  le  used  to  obtain  joint  distributions,  sometimes 
such  an  assumption  is  questionable  or  clearly  false.  Thus,  an  under¬ 
standing  of  multivariate  distributions  with  exponential  marginals  is 
desirable. 

A  number  of  such  distributions  have  been  obtained  by  methods  that 
do  not  shed  much  light  on  their  applicability.  The  purpose  of  this  paper 
is  to  present  some  meaningful  derivations  of  a  multivariate  exponential 
distribution.  These  derivations  serve  to  indicate  conditions  under  which 
the  distribution  is  appropriate. 

In  considering  the  general  problem  of  constructing  bivariate 
distributions  with  given  marginals  F  and  G,  Fr£chet  (1951)  obtained 
the  condition 

(1.1)  max  [FOr)  +  G(y)  -  1,0]  <_H(x,y)  <_  mir  [  r(x)  ,G(y)  ] . 

These  upper  and  lower  bounds  are  themselves  bivariate  distributions  with 
the  given  marginals,  and  so  constitute  solutions  to  the  problem.  Recently 
Plackett  (1965)  constructed  a  one  parameter  family  of  bivariate 
distributions  which  includes  these  solutions  as  well  as  the  solution 
H(x,y)  =  F(x)J(y);  he  also  surveyed  previous  work  on  the  problem. 


The  family  of  solutions 


(1.2)  H(x,y)  =  {1  +  a[l  -  F(x)][l  -  GQ/)]},  |a|  <  1, 

due  to  Morgenstern  (1956)  has  been  studied  by  Gumbel  (1960)  when  F 
and  G  are  exponential.  Gumbel  also  studied  the  bivariate  distribution 

H(x,y)  =  1  -  e~X  -  e~y  +  e"X"^"6^,  0  <  6  <  1, 

which  has  exponential  marginals.  However,  we  know  of  no  model  or  other 
basis  for  determining  how  these  distributions  might  arise  in  practice. 

An  interesting  model  based  on  the  exponential  distribution  has 
been  used  by  Freund  (1961)  for  deriving  a  bivariate  distribution.  However, 
the  distribution  obtained  does  not  have  exponential  marginals. 

The  models  and  characterization  investigated  in  this  paper  lead  to 
the  multivariate  distribution  with  exponential  marginals,  which  in  the 
bivariate  case  is  given  by 

(1.3)  PiX  >  s,y  >  t)  -  exp[-A^s  -  \yt  -  A^maxts.t)  ] ,  s,t  >  0. 

Each  approach  used  to  derive  this  distribution  was  chosen  for  its 
intuitive  appeal,  and  it  is  significant  that  each  leads  to  the  same 


distribution.  We  believe  that  this  distribution  is  often  a  natural  one. 


For  convenience  we  say  that  X  and  Y  are  if 

(1.3)  holds  and  refer  to  the  distribution  of  (1.3)  as  the  bivariate 
exponential,  BVE(A^ , >  A^)  * 

We  begin  by  considering  the  bivariate  case  (§2)  and  its  properties 
(§3)  before  investigating  the  multivariate  case  (§4).  Various  properties 
concerning  the  minimum  of  exponential  random  variables  are  also 
investigated  (§5)  and  ramifications  of  the  condition  that  residual  life 
is  independent  of  age  are  explored  (§6). 

2 •  Derivation  of  the  Bivariate  Exponential  Distribution. 

The  first  defining  properties  (§2.1, §2. 2)  are  motivated  by  reliability 
considerations  and  are  based  on  models  in  which  a  two-component  system 
survives  or  dies  according  to  the  occurrences  of  "shocks"  to  each  or 
both  of  the  components.  (Shock  models  in  one  dimension  have  been  utilized 
by  several  authors;  see,  e.g.,  Epstein  (1958),  Esary  (1957),  Gaver  (1963).) 

The  defining  property  of  §2.3  is  based  on  a  bivariate  extension  of  a 
central  property  of  the  exponential  distribution  that  the  distribution  of 
residual  life  is  independent  of  age,  i.e.,  ^{survival  to  time  t  +  s  | 
survival  to  time  t)  =  P{ survival  to  time  s). 

2 . 1  A  "fatal  shock"  model. 

Suppose  that  the  components  of  a  two-component  system  die  after 
receiving  a  shock  which  is  always  fatal.  Independent  Poisson  processes 
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Z2(t;\ 2)»  ^12 ( * i ^12 ^  8overn  the  occurrence  of  shocks: 
events  in  the  process  Z^(t; A^)  coincide  with  shocks  to  component  1, 
events  in  the  process  ^2  i ^2)  coincide  with  shocks  to  component  2, 
and  events  in  the  process  Z^C^;^-]^)  coincide  with  shocks  to  both 
components.  Thus  if  A'  and  Y  denote  the  life  of  the  first  and  second 
components, 

F(s,t )  e  P{X  >  s,y  >  t) 

*  P{Z1(s;A1)  ■  0,  Z2(t;X2>  *  0,  Z12 (max(s ,t) ; X12)  =  0} 

=  exp[-X^s  -  X2t  -  X12max(s,t)] . 

2.2  Non-fatal  shock  models. 

Again  consider  a  two -component  system  and  three  independent  Poisson 
processes  Z^(t;6^),  Z2(£;62),  Z^2(t;6^2)  governing  the  occurrence  of 
shocks,  with  the  modification  that  shocks  need  not  be  fatal. 

Describe  the  state  of  the  system  by  the  ordered  pairs  (0,0),  (0,1), 
(1,0),  (1,1),  where  a  1  in  the  first  (second)  place  indicates  that  the 
first  (second)  component  is  operating  and  a  0  indicates  that  it  is  not. 

Suppose  that  events  in  process  Z^(t;6^)  coincide  with  shocks  to  the 
first  component  which  cause  a  transition  from  (1,1)  to  (0,1)  with 
probability  p^,  and  from  (1,1)  to  (1,1)  with  probability  1  -  p  . 
Similarly,  events  in  process  coincide  with  transitions  from 
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uesa  rff**  ^ 


(1,1)  to  (1,0)  or  (1,1)  which  occur  with  probability  ;2  and 
1  -  :  2*  respectively.  Events  in  process  co:‘-nc:*-^e  with 

shocks  to  both  components  which  cause  a  transition  from  state  (1,1) 
to  states  (0,0),  (0,1),  (1,0),  (1,1)  with  respective  probabilities 
^00’  ?01  ’  PlO’  Pn*  Furthermore,  assume  that  each  shock  to  a  component 
represents  an  independent  opportunity  for  failure. 

Let  X  and  Y  dencte  the  life  length  of  the  first  and  second 
components.  Since  Z.(fr;6^),  Z2(t;62),  are  independent  and 

have  independent  increments,  we  have  for  t  >  s  >  0, 


(2.1)  P{X  >  s,Y  >  t) 


-hs  n  ,k 

e  — 7T —  (1  -  Pt) 
P-0  ** 


00 

I 


-62t  tt2t)1 
e  — r 


£=0 


—  (1  -  p2) 


00  00 

I  1 

n= 0  rr- 0 


"612S  (612s)  m 

6  - - Pil 


-612(t-s)  (612(t-s)) 

e  - 7?. - (Pn 


foi^ 


=  exp {-s[61p1  +  512p01]  "  P[<52P2  +  612(1  "  ^11  "  p01)]} 


By  symmetry,  for  s  >  t  >  0, 


(2.2)  P{X  >  s,Y  >  t)  =  exp{-^[61r1  +  612(1  -  pn  -  r1Q)]  -  t(&2p2  +  ^12/10^ 


Consequently,  by  combining  (2.1)  and  (2.2),  it  follows  that 


&4i- 
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(2.3)  P{ A'  >  s,Y  >  t)  =  expl-A^s  -  X^t  -  A-^maxfc  ,t)  ] , 
where 

X1  =  61^1  +  ^  12^01  ’  X2  =  62p2  +  612^10’  ^12  =  612pOO* 

When  p.  =  p2  =  1»  Pqq  =  1»  we  have  the  specialized  fatal  model.  When 
:  ^  =  p2  =  0,  we  effectively  eliminate  the  first  two  processes;  but  the 
joint  distribution  obtained  from  the  process  Z^2  is  of  the  same  form. 

2 . 3  Residual  life  independent  of  age. 

The  univariate  exponential  distribution  is  characterized  by 

(2.4)  F(s  +  t)  =  F(s)Ftt), 

for  all  e  >_  0,  t  >_  0.  Of  course,  this  is  equivalent  to 
P{.Y  >  s  +  t  |  A"  >  s}  =  P{X  >  t] ,  i.e.,  the  probability  of  surviving  to 
time  s  +  t  given  survival  to  time  s  is  exactly  the  unconditional 
probability  of  survival  to  time  t. 

Because  this  characterization  is  so  fundamental  in  the  univariate 
case,  it  is  important  to  investigate  its  multivariate  extensions.  If 
Fir  it)  -  Pf  A'  >  s,Y  >  t)  i  one  obvious  extension  of  (2.4)  is 

P(  ^  +  ^2)  =  P(s1,s2)P(t1, t2) 


(2.5) 


I 
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for  all  1^2  >  0*  To  solve  this  equation,  set  ^  =  ~  0 

in  (2.5)  to  obtain 


^l^i  +  t1)  e  F(s1 


+  t1#0)  =  F1(s1)F1(t1). 


Similarly, 


F2(s2  +  t2)  =  F(0,s2  +  t2)  =  F2(s2)F2(t2) , 

so  that  the  marginal  distributions  are  exponential.  By  choosing 
s2  ~  ~  we  obtain 

(2.6)  F(svt2 )  =  F(Sl,0)F(0,t2)  =  F1(s1)F2(t2), 

so  that  the  joint  distribution  factors  into  the  product  of  the  marginal 
distributions.  Thus  the  functional  equation  (2.5)  is  too  strong  to 
yield  an  interesting  multivariate  exponential  distribution,  but  it  may  be  a 
convenient  way  to  justify  the  assumption  of  independence. 

Let  us  examine  the  functional  equation  (2.5)  more  critically. 

Consider  again  a  two-component  system  and  suppose  both  components  have 
survived  to  time  t.  A  physically  meaningful  extension  of  (2.4)  is 
obtained  if  the  conditional  probability  of  both  components  surviving  an 
additional  time  s  =  (s^,s2)  is  set  equal  to  the  unconditional  probability 
of  surviving  to  time  (s^.s 2)  starting  at  the  origin,  i.e., 


'VO 
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(2.7)  ?{.V  >  ex  +  t,  Y  >  f?2  +  t  |  X  >  t,  Y  >  t)  -  P{X  >  8^  Y  >  f^}, 
or 

(2.8)  F(s1  +  t,s2  +  t)  -  F(s^  ,Sy)F(t  ,t) , 

for  all  ^  0,  s2  0*  t  >_  0.  This  represents  a  weakening  of  (2.5). 
Since  (2.7)  can  also  be  written 

(2.9)  P{X  >  8l  +  ty  Y  >  s2  +  t  I  X  >  e  ,  T  >  s2}  =  P{X  >  t,  Y  >  t) , 

we  may  also  check  the  physical  meaning  of  (2.9).  In  the  univariate  case 
if  we  suppose  a  functioning  component  is  of  age  s,  the  probability  that 
it  will  function  to  time  t  units  from  now  is  the  same  as  if  the 
component  were  new.  With  the  same  interpretation  for  a  two-component 
system  with  functioning  components  of  ages  and  s^,  equation  (2.9) 

asserts  that  the  probability  that  both  components  are  functioning  t  time 
units  from  now  is  the  same  as  if  both  components  were  new. 

To  solve  the  functional  equation  (2.8),  first  set  (.?^,c2)  =  (c,c) 
in  (2.8),  so  that 


F(c  +  t  ys  +  t)  =  F(s  ,e)F(t  ,t) , 


and  hence 


’Vi  ki*<rv  fWW 


f 
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r>  /  \  __  “*0S 

r  (o  jt>)  ■*  fi  , 


where  0  >_  0.  Then,  with  s 2  =  ^  in  (2.8), 


+  t,t)  =  F(Sj  ,0)F(t  ,t) 


=  F(svO)e~U. 


Consequently, 


(2.10) 


F(cc,y)  = 


e  e^Fl(x  -  y)  , 


e  6a7F2  (zy  -  x) , 


x  >_y> 


x  <_y. 


where  the  marginal  distributions  F(t,  0)  and  F(0, t)  are  denoted  by 
F^(t)  and  F^it). 

The  requirement  of  exponential  marginal  distributions  yields 


(2.11) 


r  -Qy-s^x-y) 


F(x,y) 


-Qx-&2  (y-x) 

e 


x  ^y. 


x  i  y, 


where  0  _>  ^i’^2  *n  or<^er  t^iat  ^  be  monotone'  If*  in  addition, 

+  '2  .1  6*  then  =  ®  "  ^2’  ^2  =  ^  ~  h’  and  A  ^  - 

are  all  positive  and  the  substitution  6^  =  A ^  +  A^»  ^  =  *'2  +  'l2’ 
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i*  =  +  X^2  in  (2.11)  yields  the  BVE  given  by  (1.3).  We  show 

later  (§6)  that  the  condition  6^  +  &2  1.  6  is  necessary  for  F  given 
by  (2.11)  to  be  a  distribution  function. 

3.  Properties  of  the  Bivariate  Exponential  Distribution. 

3. 1  The  distribution  function. 

An  interesting  facet  of  the  BVE  is  that  it  has  both  an  absolutely 
continuous  and  a  singular  part.  Though  distributions  in  one  dimension 
with  this  property  are  usually  pathological  and  of  no  practical 
importance,  they  do  arise  naturally  in  higher  dimensions. 

In  the  case  of  the  BVE,  the  presence  of  a  singular  part  is  a 
reflection  of  the  fact  that  if  X  and  Y  are  BVE,  then  X  -  Y  with 
positive  probability,  whereas  the  line  x  =  y  has  two-dimensional 
Lebesgue  measure  zero.  If  X  and  Y  are  lifetimes,  the  event  X  =  Y 
can  occur  when  failure  is  caused  by  a  shock  simultaneously  felt  by  both 
items,  as  indicated  in  §2.1  and  §2.2.  Simultaneous  failure  also  occurs 
with  the  failure  of  an  essential  input,  common  to  both  items.  Sometimes 
.V  =  Y  because  one  component  (say,  a  jet  engine)  explodes  and  the  other 
component  (an  adjacent  engine)  is  destroyed  by  the  explosion. 

Another  example  where  X  =  Y  with  positive  probability  is  the  case 
that  A'  and  Y  are  waiting  times  for  the  registration  of  an  event  by 
two  adjacent  geiger  counters.  Counters  are  sometimes  placed 


W  — «»  \rw-.  «. 
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in  a  specific  orientation,  say  one  above  the  other,  so  that  a 
simultaneous  event  in  each  counter  records  particles  with  nearly 
perpendicular  paths. 

Theorem  3.1.  If  F(xty)  is  BVE^^.A^)  and  X  =  X^  +  X2  +  A12> 

then 

—  ^l+^2  —  ^12  — 

F(x,y)  =  Fa(x.y)  +  F8(x,y), 


xhere 


F  (x3y)  =  exp[-A  max(z,z/)] 

e> 


is  a  singular  distribution  and 


—  x  12 

Fa(x3u)  =  expt-A^  -  A  2y  -  Xl2max(x  ,y)  ]  -  Y~+X~  expt_A  max(^,!/)] 


is  absolutely  continuous. 

Proof .  To  find  the  singular  part  F  and  absolutely  continuous 

s 

part  F  of  F  from  F(x,y)  -  a F  (x,y)  +  (l-a)F  (x ty)  ,  0  <_  a  <_  1, 

a  cl  s 

2— 

we  compute  a fa(x,y)  =  9  F(x,y) /dxdy.  a  is  then  obtained  as  the  integral 

of  S  (x,u).  With  a  and  F  determined,  F  can  be  obtained  by 

-  a  a  s 

subtraction.  We  compute 

A 2  ( A 2^"A ^ ^  (x » y)  >  x  >  yf 


3 2F(x,u) 

3*3  ^ 


afa  *y )  =  { 


a i ( a2+ a^2) * (x >y)> 


x  <•  y. 


-12- 


and  hence,  for  x  <  y, 


olF  (x,u) 
a  - 


If  a /  (u,v)du  dv 
x  y 


v 


A  i  ( A  12  ^  /  dv  J  du  e  1 

y  x 


A2+A12)^ 


00  u 


+  a2ca1+a12)  /  /  dy  e 

2/  ^ 


-(A-j+A^k-A^ 


-A^-A^-A^y  A12 

=  P  —  -1  p  ^ 


wich  a  symmetric  expression  when  ^  >_y.  Combining  both  cases. 


Fa(x,y)  »  «*,*)  -  -J1  e-X 


1  /  X+A12 

It  follows  from  the  condition  F  (0,0)  =  —  [  2  -  — : — J  =  1  that 

a  a  \  A 

u  =  (A  +  A  )/A.  With  a  and  F  known,  the  singular  part  F  can 

X  Z  (7  S 

be  obtained  by  subtraction: 


Fs(x,,)  = 


(F(x,i/)-aF (x,y)]  ,  „% 

_ _ _ a  _  -A  max  (j:  ,zy ) 


1-a 


3 . 2  Moment  generating  function. 

Since  we  are  considering  positive  random  variables,  the  Laplace 
transform  (moment  generating  function)  exists  and  is  natural  to  compute 
in  place  of  the  characteristic  function. 


w 


f 'TT’SU'tB  I  iWr  *  v.-rt*  rf.lwl. 
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Bec  ause  of  the  fact  that  the  BVE  has  a  singular  part,  direct 
computation  of  the  Laplace  transform  fe  JdF(xtu)  is  somewhat 
tedious;  the  integral  must  be  computed  for  the  absolutely  continuous 
and  singular  parts  separately.  Integration  by  parts  affords  a 
considerable  simplification;  if  G(0,y)  e  0  e  G(x, 0)  and  G  is  of 
bounded  variation  on  finite  intervals,  it  follows  from  results  of 
W.  H.  Young  (1917)  that 

00  OO  00  00 

(3.3)  If  G(x,y)dF(x,y)  =  /  /  F  (x  ,y)dG  (x  ,y) . 

0  0*  00 


This  change  is  of  particular  use  when  G(x,y)  is  absolutely  continuous 
and  F  is  easy  to  compute. 

To  utilize  (3.3)  we  need  a  kernel  G  satisfying  G(0,y)  E  0  E  £(;r,0). 
Tlius  we  replace  the  kernel  e  of  the  Laplace  transform  by 

(l-e~sx)  (l-e~^),  obtaining 


4 (s » t) 


00  00  OO  OO 

=  J  J  (1-e  SX)  (1-e  ^y)dF(x,y)  =  J  J  F(x,y)st  e  ^^^ax  dy 


0  0 


0  0 


-  /  /  st  e 

o  y 


■  x(  A  j+A  12+s  )”£/(*  2+t  ^ 


OO  OO 


-x ( A  j+s ) -y  ( X 2+A ^ ) 


dxdy+Jfste  x  x  dy  dx 

0  x 


st (A+A^+s+i) 


(A+s+t) ( A^+A^2+s) (A2+A^2+t)  ’ 


where  >  =  A  +  A2  +  A^  •  Although  the  transform  <f  is  directly  useful  as 
a  moment  generating  function,  its  powers  are  not  transforms  of  convolutions. 


However,  the  Laplace  transform  i p(s,t)  can  be  obtained  from  the 
relation 


i p(s,t)  =  <t>(s,t)  ~  <p(°°tt)  ~  <p(s,°° )  +  1 

(\+s+t)  ^A2+A12^~s*:A12 

(\+s+t)  (X^+X^2+s^  C A 2"*"^  12"^^ ^ 


To  obtain  the  moments  of  the  BVE  we  compute 


EX  = 


Al+A12 


Var  X  = 


(A1+A12) 


2  ’ 


EY  = 


A2+A12  ’ 


Var  Y  = 


(a2+x12) 


2  ’ 


from  the  marginal  distributions  and 


EXY  =  ^ 


2 

dsdt 


s=t=0 


d2$ 

'dsdt 


s~t-0  A\A1+A12 


a2+Ai2 


Hence  the  covariance  is  given  by 


covU.y)  = 


12 


a(a1+a12)(a2+a12)  * 


and  the  correlation  is  p(Y,Y)  =  A^/A.  Note  that  0  <  p(lj)  <_  1. 

Higher  moments  are  not  difficult  to  compute  directly  from  the  equality 
/.r'.*'  aF(x,y)  =  ^yv  ^ F(x,y)dx  ay  (t,j  >  0)  which  follows  from  (3.3). 


*•-  new 
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If  i  and  j  are  positive  integers,  we  obtain  with  y  =  A  •  +  A.„, 

t  2.  12 

2=1,2,  that 


t-1  j-1 

;:a’V  =  j’r(t+i)  y  — T(J+l0  +  iT(j+ 1)  ^  — r.(i+ftl  . 

»  r(^+l)y|  \’1+k  k=0  T(k+l)yC2  kX'r  k 


3.3  Convolutions. 


From  the  "fatal  shock"  model  (§2.1)  with  k~  1  spares  for  each 

( k ) 

component,  we  obtain  the  k  -fold  convolution  F  of  the  BVE.  With 

s  <  t. 


F{khs,t )  =  y  P{Z  (s)  =  £,Z  At)=l+m}P{Z  (s)  <  fc-l-fc}P{Z  (s)  <_  fe-l-i-n} 
Hr?<fc-1 


-  1 


k~  1  "X12Sn  A  X12(t~s)  um 

Y  e  (A^s)  e  1^12 


Htt?=0 


e  1  (A1s)t  ^_1^"we  2  (A 2t)J 

h  77  j4 


71  h  <)S  n  “ A^rt(fs) 

fc-1  12  /I  12  r  i  (4- 

^  e  (A^s)  e  ^  12  ^ -* 


£+r;=0 


r  k~ l-l  -x  ,  r  k-l-l-n-y 
/  x _ e  ax  /  2 _ £_I 

J  (k~  1-0- ’  ^  (fc-l-fc-rc).' 


In  particular,  if  P  <  t. 


V  ^ ^  ^12^ 

e  [(1+X1s)(l+X2t)  +  A12(t-s)(l+A1s)  +  A^s]. 


a-) 

Of  course,  F  is  a  bivariate  gamma  distribution. 

3. A  Distributions  obtained  by  a  change  of  variables. 

If  A’  is  an  exponential  random  variable,  then  aX  is  exponential 
for  all  a  >  0.  However,  if  (Af , Y )  is  BVE,  then  (aX ,bY)  is  BVE  only 
if  a  -  b  >  0.  The  distribution  of  ( aX,bY )  for  a ,b  >  0  is  easily 
seen  to  be  of  the  form 

-A  x-A -y- max ( A , A , y ) 

(3. A)  F(x,y)  =  e  . 


This  distribution  has  exponential  marginals  and  includes  the  BVE  as  the 

special  case  A3  =  A^  =  A^.  It  also  includes  the  upper  bound  of  (1.1) 

when  ."1  and  Fn  are  exponential  (A.  =  A_  =  0). 

-L  l.  L  Z 

Other  changes  of  variables  in  the  BVE  may  be  of  interest,  in 

particular,  the  distribution  of  ,Y^^ )  is  a  bivariate  Weibull 

distribution,  namely, 

By  By 

_  x  -A  2y  -A12max(x  ,w  ) 

t  (i’  y'y  )  —  6  • 
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I 


l 


3 . 5  Representation  in  terms  of  independent  random  variables. 

Theorem  3.2.  (A’,J)  is  BVE  if  and  only  if  there  ,  xist  indepen 
•  event  ial  random  variables  U,  V  and  W  such  that  X  =  min('V.) 


l'* 


» 


Kt 


Y  -  min  ( V ,  li) . 


This  theorem  is  an  immediate  consequence  of  the  fatal  shock  model 
discussed  in  §2.1.  It  can  be  an  aid  in  reducing  questions  concerning 
dependent  exponential  random  variables  to  questions  concerning  independent 
exponential  random  variables.  An  illustration  of  its  usefulness  is  given 
in  §5. 


3.6  Comparison  of  the  bivariate  exponential  with  the  case  of 
independence . 

It  is  interesting  to  compare  the  survival  probabilities  (with  marginals 
fixed)  of  the  dependent  and  independent  cases. 

The  BVE  has  marginals 

-  -(A1+\i2)x  -(A2+A12)z/ 

F1  (.r)  =  e  ,  F2(y)  =  e 

Clearly,  the  difference 

-A.x-A^-A.  „max(x,zv)  -h  min(x,!v) 

F(x,y)  -  F^F^y)  »  e  "  (1-e  “  ) 

is  positive  for  all  .r  and  y,  so  the  probability  that  both  items 


survive  is  greatest  in  case  of  dependence.  However,  it  is  easily 
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verified  that  for  any  bivariate  distribution  F  with  marginals  F^ 
and  » 


'(x,y)  -  F^(x)F2(y)  =  F(x,y)  -  F^  {x)F^  (y) , 


so  the  probability  that  both  items  fail  is  also  greatest  in  the  case  of 
dependence.  This  means  that  in  the  case  of  a  series  system  (which 
functions  only  when  both  items  function),  system  survival  probability  is 
greatest  in  the  case  of  dependence.  On  the  other  hand,  in  the  case  of  a 
parallel  system  (which  fails  only  when  both  items  fail),  system  survival 
probability  is  greatest  in  the  case  of  independence. 

To  determine  the  greatest  discrepancy,  ma x[F(x,y)  -  F^ (x)F^ (y) ] »  note 

*>y 

that  if  x  <  v , 

_  _  x-(\?+\  ?)y  -A 

F(xty )  -  Fl(x)F2(i/)  =  e  (1-e  ' 


is  decreasing  in  y,  so  that 


F(x,y)  -  F1(x)F2(n)  <_  e"A 


-A12min(x,^)  _u  "A12*\ 
e  )  =  e  (1-e  ), 


where  t  =  min(x,i/).  The  maximum  of  the  right-hand  side  occurs  at 


1  12 

t  =  “ —  log(l  +  — : — )  and  is  equal  to 
12  A 


max[F(x,zv)  -  (x)F2  (u)  ]  =  66 / (1+5 ) 1+6 , 


where  A  =  A/A^.  In  terms  of  the  correlation  p(a,;/)  -  A ^ /A,  the 

■  •  •  r  o  /  y i ,  \ (1+p) , 1/p 

maximum  discrepancy  is  [p  /(1+p)  ] 


4 .  The  Multivariate  Exponential  Distribution, 


4.1  Derivations. 


To  fix  ideas,  we  consider  first  an  extension  of  the  fatal  shock 
model  to  a  three-component  system.  Let  the  independent  Poisson  processes 
IfCtjAi),  ,  Z^(t\X^)  govern  the  occurrence  of  shocks  to 

components  1,  2,  3,  respectively;  A^)  *  Z^(t;X^)  t  Z^UiX^) 

govern  the  occurrence  of  shocks  to  the  component  pairs  1  and  2,  1  and  3, 

2  and  3,  respectively;  and  ^223  ^  ’ ^123 ^  8overns  t^ie  occurrence  of 
simultaneous  shocks  to  components  1,  2,  3.  If  ,  X^ ,  denote  the 
life  length  of  the  first,  second,  and  third  components,  then 


FU’^.a^a^)  =  FU'^  >  a^  X^  >  ^3  >  ^3} 

=  P{Z1(a:1)  =  0,  Z2(a’2)  =  0,  (a^)  =  0,  (max^.a^ )  =  0, 

(4.1)  Z^^  (max  (a^  .a^) )  =  0,  Z^  (max  (a2  ,a^) )  =  0,  Z^2^  (max  (a^  ,x^  ,a^ 

=  exp  [-A1a1-A2a2-A^a2-A12max(a1  ,a2)-A1^niax  (a^  .a^-A^max^  a^) 

~^123max^a'l’a'2  ,X3^  ^ ' 

It  is  clear  that  similar  arguments  yield  t he  ^-dimensional  exponential 


distribution  given  by 


1 


WL 
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_  n 

(A. 2)  FU',  ,  •  •  •  ,x  )  =  exp[-  l  \  .x .  -  E  A  • -max(.r  .  ,£  .)  -  E  A  .  ..  max  (.r .  ,x  .  ,o\  ) 

12  *  'L  Z  •  •  L.  "is  fj  •  •  7  rC  t.  .7  A' 

1  t<J  *'  7<J<k 

-•••-  A,  0  max  (a.*,  , .  . .  ,£  )]. 

12 . .  ,n  I  2  n 

To  obtain  a  more  compact  notation  for  this  distribution,  let  S  denote  the 

st'  of  vectors  (s,  ,  ...,s  )  where  each  s.  =  0  or  1  but 

I  n  j 

(e.,...,s  )  i  (0,...,0).  For  any  vector  s  e  S,  max(x.s.)  is  the  maximum 

-L  yi  *b  Z- 

of  the  a*  ,’s  for  which  e.  »  1.  Thus, 

"  t 

(A. 3)  Fix, .  •  yX  )  =  exp  [  -  lc  A  max(x.s  .)  ]. 

In  sei  s  t  t 

For  example,  for  n  -  3  the  correspondence  with  (A.l)  is  A^qq  =  A^, 

*01 0  =  A2’  A001  =  A3’  A110  =  A12 ’  A101  =  A13’  A011  =  A23’  Alll  =  A123‘ 

We  call  the  distribution  given  by  (A. 2)  or  (A. 3)  the  multivariate 

exponential  distribution  (abbreviated  MVE) .  Note  that  the  (n-1)- 
dimensional  marginals  (hence  ^-dimensional  marginals,  k-1 ,2 , . . . ,n-l) 
are  MVE.  In  particular,  the  two-dimensional  marginals  are  BVE. 

In  the  bivariate  case  (§2.2)  the  fatal  and  non-fatal  shock  models 
both  yield  the  BVE.  Indeed,  if  we  assume  in  the  multivariate  case  that 
shocks  need  not  be  fatal  but  instead  cause  transitions  with  varying 
probabilities,  then  by  a  tedious  but  direct  calculation  we  again  obtain 
the  MVE. 

Consider  now  the  requirement  that  the  residual  life  is  independent 
of  age ,  i . e .  , 
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P{.Y,  >  s,+t,...,.Y  >  s  +t  L  >  t,...,A-  >  t)  *  P{A.  >  s.  >  s  }, 

1  1  n  n  '  1  n  1  1  n  n 


or 


(4*4)  F (s * •  •  •  •  t s  )  *  P(a,,...,&  )F(t *  •  t  *  jt) • 

In  in 

If,  in  addition,  the  (n-l)-dimensional  marginals  are  MVE,  then  the 

solution  of  (4.4)  is  the  n -dimensional  MVE.  To  see  this,  note  that 

P(e,...,s)  *  e  6s  follows  from  (4.4)  with  e,  »•••*  s  *  s.  The  choice 

i  n 

*  0  in  (4.4)  yields 


(4.5)  P(s1+t,...,s^_1+t,t)  ■  P(e1,...,s^_1,0)P(t,...,t) 


e  0t*’„-1<V‘**,V1). 


where  F  ,  is  an  (n-l)-dimensional  marginal.  Using  the  assumption 
n-l 

that  P  .  is  MVE,  (4.5)  yields  (4.2)  or  (4.3)  on  the  domain  x  <_;r. , 

tsl»2f • • • y W"1 • 

4.2  Properties  of  the  MVE. 

The  MVE  of  dimension  n  is  not  absolutely  continuous  (except,  of 
course,  for  n  ■  1).  As  in  the  bivariate  case,  this  is  because  a  singular 
part  is  present:  although  any  hyperplane  of  dimension  less  than  n  has 
>:-dimensional  Lebesgue  measure  zero,  each  of  the  hyperplanes 

x.  -  x.dtS),  x .  «  or..  -  x,  distinct),  etc.,  has  positive  probability. 

*  v  1  J  K 

For  example,  by  referring  to  the  fatal  shock  model  (§4.1),  we  see  that 
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.V .  *  X  .  i  X,  ,  for  all  k  +  i,j  when  the  first  event  in  a  process 

t  * 

governing  shocks  to  components  i  or  j  occurs  in  the  process 
_'..(£).  Because  it  is  quite  cumbersome  and  seems  to  be  of  little 
importance,  we  do  not  further  discuss  the  decomposition  of  the  MVE  into 
parts  absolutely  continuous  with  respect  to  Lebesgue  measures  on  various 
hyperplanes. 

As  in  the  bivariate  case,  there  is  considerable  simplification  if 
in  place  of  the  Laplace  transform  we  compute 


, • • • “ 


/  n  (1-e 


-a  .x . 

i  z 


)dF(x . 


*  *  *  *  *^n  ^  * 


The  extension  of  (3.3), 

oo  oo  ao  oo 

/  *•*  /  G(x.,...,x  )dF(x.,...,x  )  -  /  •••  /  F(x.,...,x  )dG(x.,...,x  ), 

o  o  ”  ”o  0  ” 

holds  whenever  G  is  of  bounded  variation  on  finite  intervals  and  G  is 
identically  zero  if  any  argument  of  G  is  zero.  Using  this  integration  by 
parts  formula,  we  obtain 

Oo  00 

n  f  f  _  n  n 

(4.6)  ♦(s1,...,e  )  ■  n  8.  J  •••  /  F(x. ,. . .  ,x  )exp(-  I  exc.)  n  dr.. 

*  n  1  z  Q  0  A  n  i  *■  1  i  *■ 

The  evaluation  of  this  integral  is  straightforward,  though  somewhat  trouble¬ 
some  because  it  must  be  evaluated  as  a  sum  over  all  n!  regions 

x.  >•••>  x..  .  It  is  convenient  to  replace  the  parameters  X  by  new 

*  v  s 

1  r. 

parameters  s  t  S,  defined  by 
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Q 

(% 


I 

J’SjH) 


A 


i.e.,  o  is  the  sum  of  all  A  such  that  some  coordinate  is  1  in 

-  s  r 

both  r*  and  e.  For  example,  with  w  -  3,  is  the  sum  over  all 

A  where  s  or  s  =  1: 

c  1  J 


^101  “  Alll  +  A110  +  A101  +  A011  +  A100  *  A001* 


If  >  maxfcr^, . . .  txn)  »  then 


» • • • »xn) 


i  1  **’°  1f(0,x2,x3,. 


so  that 


ns 


/ 


x^  >  max (*2 •  ■ 


_  n  n 

F(x. . .  ,x  )exp(-  Z  s  -r  .)  II  dx . 
.  ,x  )  1  n  i  t  t  i  t 

*  n' 


ns . 


‘10* 


o+*i 


-^l0...0+ei)max(X2 . VF 

/  e  -h 


n-l<*2 . xn)exP(“  f  \ 


This  integral  is  of  dimension  n-1  but  otherwise  is  of  the  same  form  as  (4.6) 
Assuming  the  ordering  x^  >  x2  *****  xn*  we  obtain  by  iteration  that 


/ 


_  W  W 

F  (xx . x^)exp(-  1  sxj  J 


x  >*»»>x  >0 
r. 


<^10-  •  «4*l+*2)*1  ■ ' 


<?n— l+VV'+V’1  J  V 
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Tlius , 


'<^1 . •„>  *  J  Br’:'(?io..-o+si)"1<-'no-..o+si+s2> 


where  " '  is  the  summation  over  all  permutations  of  the  indices.  For 
example , 


em+si+s2+s3 

U’ll  SrsfSr.) 

1^3  c 1^2^  3 


^110+sl+s2^  ^100+cl^  +  ^010+S2^  ^ 


+  ^101+S1+S3^  ^<i?100+Gl^  +  ^001+,;3^  ^ 


+  (-011+s2+S3)  1[(^010+S2)  1  +  (2nm+6V  ^ 


001  3' 


A  final  but  very  important  property  of  the  MVE  that  we  mention  is  its 
representation  in  terms  of  independent  exponentials.  As  in  the  bivariate 
case  (Theorem  3.2),  we  obtain  from  the  fatal  shock  model  that  if  A'^,...,A 

are  MVE,  there  exist  independent  exponential  random  variables  Z  ,  si  S 

s 

such  that  A’ .  =  min  Z  . 
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5 .  Minima  of  Exponential  Random  Variables. 

An  important  property  of  independent  exponential  random  variables 
and  Y  is  that  min(.V,Y)  is  exponential.  It  is  also  known  [Ferguson  (1964)] 
that  if  the  independent  random  variables  X  and  Y  have  absolutely  continuous 
distribution  functions,  then  min(A',Y)  is  independent  of  X  -  Y  if  and  only 
if  A"  and  Y  are  exponentially  distributed  (with  the  same  location  parameter, 
possibly  not  zero).  Thus,  minima  play  an  important  role  in  the  case  of 
independent  random  variables  and  we  examine  their  role  in  the  dependent  case. 

If  (A,  Y)  is  BVE,  then 

— .  A  -y* 

P{min(A',Y)  >_x}  =  P{X  >_  x ,  Y  >_x}  =  e  , 


where  A  =  so  that  the  minimum  of  X  and  Y  is  exponential. 

(This  fact  is  also  an  immediate  consequence  of  Theorem  3.2.) 

On  the  other  hand,  the  minimum  of  dependent  exponential  random  variables 
need  not  be  exponential;  e.g.,  if  X  and  Y  have  one  of  the  bivariate 
distributions  studied  by  Gumbel  (1960), 


or 


Y(x,u) 


-x-u-6xu 

e 


J 


F(x,i<)  =  e  X  "y[l  +  a(l-e  ")(l-e  ;>)], 


-  ■  flBWHMmU 
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then  min(.V,y)  is  exponential  only  in  the  case  of  independence 
('  or  =  0).  Similarly,  if  F  is  the  lower  bound  of  (1.1),  i.e., 

F(x,y)  =  max  ^  Or)  +  F2(y)  -  1,  0], 

then  min(.Y,y)  is  not  exponential,  even  though  F^  and  F 2  are 
exponential. 

But  there  are  many  bivariate  distributions  with  exponential  marginals 
such  that  min(A’,y)  is  exponential.  Such  distributions  must  satisfy  the 
functional  equation 

(5.1)  F (.r-hv  ,x+u )  =  F(x,x)F(y  ,y) . 

In  addition  to  the  BVE,  the  distribution  given  by  (3.4)  has  this  property. 

Since  there  are  many  solutions  of  (5.1)  with  exponential  marginals,  it 
may  be  of  interest  to  consider  those  bivariate  distributions  for  which 
min(aA',rY)  is  exponential  for  all  a,  b  >  0.  An  investigation  of  this 
stronger  condition  shows  that  such  a  distribution  must  have  the  form 

(5.2)  Hx,y)  - 

where  is  a  non-negative  function.  Again,  there  are  many  such 

distributions,  including  the  distribution  given  by  (3.4).  Of  course,  F 
defined  by  (5.2)  is  not  a  distribution  function  for  all  functions 


As  previously  mentioned,  it  is  well  known  that  if  X  and  Y  are 
independent  exponential  random  variables,  then  min(A',y)  and  X  -  Y 
are  independent.  This  conclusion  is  also  true  if  .V  and  y  are 
dependent  but  have  the  bivariate  exponential  distribution.  It  is  some¬ 
what  tedious  to  prove  this  fact  directly,  so  we  make  use  of  Theorem  3.2 
and  our  knowledge  of  the  independent  case. 


Let  X  =  min (U,W),  Y  =  min(I/,fv'),  where  U,V  and  W  are 
independent  exponential  random  variables.  Then  min(A,y)  =  min(U,  V,W) 


{  U  -  Vt 


and  A’  -  Y  = 


U  -  W, 
W  -  V, 


0, 


0  <  V  -  U  <  W  -  U  or  0  <U-V<W-V, 

0  <  W  -  U  <  V  -  iJ, 

0  <  W  -  V  <  V  -  Vy 

0<U-W<v-W  or  0  <  1 7  -  W  <  11  -  W. 


The  independence  of  min(A',y)  and  X  -  Y  follows  from  the  independence 
of  ( V-l-Y)  and  min  (IJ,  V,W)  .  The  latter  may  be  obtained  by 
applying  the  two-dimensional  result  to  conditional  distributions. 

It  would  be  of  theoretical  interest  to  know  the  class  of  bivariate 


distributions  for  which  min(A',l’)  and  A'  -  Y  are  independent. 


. :  mmmm 
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6.  Further  Results  for  the  Functional  Equation  F(s^+t ,s2+t)  =  F(s^ »s2)F(t , t)  . 

In  Section  2.3  we  introduced  and  motivated  the  functional  equation  (2.8) 
and  found  the  general  solution  to  be 


(6.1) 


F(x*y) 


e  ^F^ix-y) , 
e~QxF2(y-x), 


x  >_  y, 

x  l  y- 


When  F^,  F„  are  exponential  distributions  with  parameters  6^,  6^ 
satisfying  6^,  62  <_  0  <_  <5^  +  62,  F(x,y)  is  the  BVE.  However,  F(x,y) 
specified  by  (6.1)  is  a  distribution  only  for  certain  marginals  F  ^  and 

F  2  * 

In  order  that  F(x,y)  be  a  distribution  function,  it  is  necessary,  for 
any  two  points  Or^,[y^)  and  (x2,y2),  that 

(6.2)  FGr^zvp  +  F(x2,y2)  -  FCt^,^)  -  Fix^y^  >_  0. 


(6.2)  Is  equivalent  to  conditions  on  F^  and  F2  which  depend  upon 
Cr^,^)  and  ( x2,y2 );  e.g.,  if  <_  x2  <_  y^  <_z/2>  (6.2)  becomes 

_  _  e(x2-x1)  _  _ 

[^2  ^ i~ *^i  ^  —  ^2  ^ 2~X1^  ^  —  F 2  ^ l” 2 ^  ~  F 2  ^ 2~ *^1  ^  * 


Such  conditions  are  not  easily  verified;  we  obtain  some  alternative 

conditions  when  the  marginal  distributions  have  densities  f,  and 

*  1 


satisfying  certain  regularity  conditions. 


and 
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Theorem  6.1.  Let  F.(x)  be  a  distribution  function  with  density 
f.(x)  which  is  absolutely  continuous  and  for  which  lim  f  ,(z)  =  0, 

,'*1,2.  In  order  that  F(xty)  given  by  (6.1)  be  a  bivariate  distribution , 
it  is  necessary  and  sufficient  that 

(i)  0  1^(0)  +  /2<0)  1  26, 

d  log  f.(z ) 

(ii)  - ''dz  —  ~9*  for>  z  —  j*l,2. 

Proof.  F(xty )  will  be  a  distribution  function  if  and  only  if  both 
the  absolutely  continuous  part  F  ( x,y )  and  the  singular  part  F  (x,i>) 

CL  S  v 

are  distribution  functions  and  F(x,y)  is  a  convex  mixture  of  Fa(x,y) 

and  F  (x,zy),  i.e., 

© 

(6.3)  F(xty)  -  aF^fcr.t/)  +  (l-a)Fs(x,z/) ,  0  <_  a  <_  1. 

To  determine  the  conditions  on  F  Or, tv)  and  F  (x,tv)  we  compute 

CL  S 

2— 

3  F/tedy  *  afa(x,y)  and  obtain  a  from  F^00,®)  *  1.  The  singular 
part  F  ( x,y )  is  concentrated  on  x  m  y,  so  that  we  can  obtain  it  from 

(l-a)F  (x,x)  -  F(x,x)  -  a F  (x,x).  Carrying  out  these  steps,  we  have 

&  CL 

e  0^[/|(x-t/)  +  (x-£/ )  ] ,  x  >_yt 

e  ^[^(tv-^)  +  0/2  x  —  V' 

J  afa(xty)dxdy  *  1  -  |’/‘1(0),  J  afQ(xty)dxdy  »  1  -  ”  f2(°)> 

x>y  x±y 


(6.4) 


±2£JL £*vl 

Zxdy 


.!.  mmM 
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so  that 

OC  00 

(6.5)  ot  =  /  /  af  (x,y)dxdy  =  2  -  ±  [/  (0)  +  /  (0)]. 

0  0 

Thus,  the  absolutely  continuous  part  F ^(x  .,y)  of  F(x,y)  has  density 
(x,y)  given  by  (6.4)  and  (6.5).  We  compute 

00  00 

F  (xtx)  =  a  1  f  du  f  av  e  Qu[f'  (v-u)  +  0/Ty-y)] 
a  x  u 

00  00 

+  a  1  J  dv  /  fl’n  e  (u-y)  +  0/(u-i>)] 

X  V 

-0:r 

=  e 

But  F(a:,x)  =  exp(-6a;),  so  that 

F  (x  ,x)  =  [F(x,x)-aF  (x,x)]/(l-a)  =  exp(-0.r). 
s  a 

Since  F  (x,u)  is  concentrated  on  x  =  u.  we  conclude  that 

o 

(6.6)  F  (x,y)  =  exp[-0  maxCc,#)]. 

O 

Thus,  F  is  a  valid  distribution  function  if: 


•wn 


r 
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(i)  F  is  a  convex  mixture  of  F  and  F  ,  i.e.,  0  <  a  <  1. 

a  p  —  — 

From  (6.5)  this  condition  is 

9  <  ^(0)  +  ,f2(0)  1  26. 

(ii)  F 'a  is  a  valid  distribution  function,  i.e.,  f  ^(x  ,y)  >_  0. 

From  (6.4)  this  is  f'.(z)  +  Qf.(z)  >_  0,  i=l,2,  or 

t  2 

equivalently , 

d  log  f^(z)/dz  >_  -0.  || 

We  now  check  the  conditions  of  the  theorem  for  the  important  Weibull 
and  gamma  distributions.  The  respective  density  functions 


P—1  R 

y(r.)  =  y(2;g,6)  =  36r:  exp(-<I'r;P) , 


z  >  0,  g  >  0,  5  >  0, 


j(n)  =  ?(r.;6,5)  =  yygy  <5026  1exp(-6s),  z  >  0,  6  >  0,  6  >  0, 


satisfy  the  regularity  conditions.  It  is  easily  checked  that 


Um  i-L°S..uM  ,  Um  ±  1,°«  fiW  ,  1£  a  >  l,  and  Urn  d  lofi  = 

az  az  n  az 


;-0 


lim  - )  -  -uo  if  a  <  1.  Because  of  condition  (tt),  F,  or  F0 

n  az  i  ^ 

3+0 

can  be  Weibull  or  gamma  distributions  only  in  the  special  case  that  they 


are  exponential. 
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In  the  exponential  case,  condition  (t)  becomes  ®  1  ^  +  ^  1  ^ 
where  and  6^  are  the  parameters  of  and  .  Condition  (ii) 

requires  ^  <_  0,  1.  Thus, 


c  (x tu)  — 


(  e  ^F^x-y) ,  x  >_  m, 


[  e"6'rF9(^-x)  ,  x<_i/, 


is  a  bivariate  distribution  with  exponential  marginals  f.  and  if 

and  only  if  <_  6,  ^  —  6»  ^1  +  ^2  —  0‘ 

Remark.  Suppose  satisfies  conditions  (i)  and  (it)  so  that 

F(x,y)  defined  by  (6.1)  is  a  valid  bivariate  distribution,  and  similarly 
suppose  (t/2  *^2 )  satisfies  ("O  and  (t7*).  Then  the  mixture 
(',;'^  +  (l-y)c?^,  yf^  +  (l-y)^)  satisfies  the  conditions  and  yields 
another  solution  to  the  functional  equation  (2.8).  In  particular, 
marginal  distributions  which  are  mixtures  of  certain  exponential  distribu 


yield  solutions. 
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